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Foreword 


•u  It  has  become  evident  to  most  managers  that  a  capability  in  systems 
analysis  is  a  prerequisite  of  success.  Not  only  is  systems  analysis 
useful  in  decision  making  and  problem  solving,  but  it  has  become  the 
leading  buzzword  of  the  day.  This  can  be  seen  by  the  fame  or  notoriety 
of  the  DOl)  systems  analysis  group  developed  by  Robert  McNamara,  the 
fact  that  the  management  science  groups  of  most  universities  stress  systems 
analysis  in  their  brochures,  and  the  salary  wars  being  waged  to  hire 
systems  analysts. 


This  paper  is  designed  to  penetrate  the  mystique  which  surrounds 
systems  analysis.  In  addition  to  defining  systems  analysis,  the 
advantages  and  limitations  of  this  technique  arc  discussed,  a  general 
purpose  methodology  is  developed,  and  a  description  of  one  application  of 
the  methodology  is  provided. 


The  opinions  expressed  in  the  paper  are  those  of  the  author  and  not 
those  of  AMC. 
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To  be  successful,  the  modern  manager  must  be  able  to  assimilate 
large  quantities  of  data.  It  has  been  said  that  our  knowledge  has 
doubled  in  the  past  twenty  yoavs  and  it  is  estimated  that  it  will  double 
again  in  the  next  ten  years,  hot  only  does  this  affect  the  scientific 
community  but  it  affects  all  of  us.  Every  day  new  developments  occur 
which  generate  reams  of  data  which  arc  later  grouped,  analyzed,  and 
published.  As  a  result,  the  modern  manager  finds  himself  confronted 
with  an  ever  increasing  amount  of  useless  data.  Surrounded  by  data  on 
every  conceivable  facet  of  his  operation,  the  manager  diligently  searches 
for  a  method  of  separating  information  from  chaff.  During  this  search, 
the  concept  of  systems  analysis  is  first  discovered.  An  aura  of 
contentment  nov;  settles  about  our  executive  as  the  mystique  of  systems 
analysis  exerts  its  influence.  Unfortunately,  the  decision  maker  often 
finds  that  systems  analysis  has  provided  additional  data,  but  no 
additional  information.  Since  so  much  controversy  surrounds  this  subject, 
on  intensive  examination  of  the  nature,  value,  and  limitations  of  systems 
analysis  is  needed. 

'Definition 

Systems  Analysis  is  defined  as  a  systematic  approach  to  problem 
solving  which  utilizes  quantitative  management  science  techniques  to  develop 
and  evaluate  a  spectrum  of  solutions  to  long  range  problems.  Tho  length 
of  the  effort  does  not  determine  it  something  is  to  be  classified  as  a 
"systems  analysis  study."  If  all  steps  in  the  enclosed  methodology  havo  not 
been  properly  considered,  this  effort  is  merely  an  evaluation  based  on 
expertise.  Unfortunately,  too  many  incomplete  efforts,  which  can  lead  to 
poor  decisions,  have  been  termed  "systems  analysis  studies."  To  arrive  at 
an  optimum  solution,  cither  the  ef fcctivcness  of  tho  system  should  bo 
maximized  or  the  costs  minimized.  Systems  analysis  can  be.  applied  to 
materiel  effectiveness,  organizational  structure,  and  product  mix  problems. 
During  tho  conduct  a  systems  analysis  study,  alternatives  are  developed 
to  meet  specific  requirements  for  a  variety  of  environments ;  then  tho 
alternative  is  selected  which  best  satisfies  these  requirements. 

System  &  Subsystem  Relationship 

Systems  analysis  is  applicable  to  any  type  of  problem  if  the  tcchnir;ue 


is  adapted  to  take  into  account  the  individual  aspects  of  each  problem. 

If  the  systems  analysis  effort  is  to  be  productive,  it  is  vital  that  the 
system  under  consideration  he  carefully  defined.  A  system  is  composed  of 
men,  material,  and  machines;  and  the  limits,  relationships,  and  effects 
of  each  part  of  tho  system  must  be  explicitly  separated  from  the 
environment,  which  is  defined  as  everything  outside  the  system.  Furthermore, 
each  subsystem  must  be  clearly  defined  and  its  relation  to  other  subsystems 
and  tho  system  established.  In  practice,  defining  the  subsystem  boundaries 
and  determining  the  interface  coefficients  is  extremely  difficult.  After 
developing  the  subsystem  relationships,  the  value  of  each  parameter  must 
be  related  to  overall  effectiveness.  If  a  systems  analysis  effort  is  to  be 
successful,  a  clear  distinction  must  be  made  between  each  subsystem,  the 
system  and  the  envi ronn.cnt . 

A  final  source  of  difficulty  arises  if  past  studies  have  been  conducted 
to  optimize  certain  technical  characteristics  of  the  system  and  an  attempt 
is  made  to  sum  the  results  of  these  technical  subsystem  studies  into  a  system 
study.  The  results  of  those  subsystem  effectiveness  studies  cannot  simply 
be  summed  to  give  total  effectiveness  because  the  objectives  of  the  system 
study  are  not  necessarily  the  same  as  the  objectives  of  the  past  subsystem 
studies.  Furthermore,  the  system  operates  under  different  constraints 
than  the  subsystems.  Realizing  that  a  systems  analysis  study  is  composed 
of  a  number  of  subsystem  studies,  both  common  constraints  and  a  method  of 
assigning  relative  weights  to  the  results  of  each  subsystem  study  must  bo 
developed.  If  the  above  factors  are  not  considered,  a  lcss-than-optimal 
solution  will  bo  obtained. 

Time  Frame 

One  of  the  more1  important  points  illustrated  by  tho  definition  of 
systems  analysis  is  that  long  range  problems  arc  specified.  Does  this 
mean  that  short  range  problems  must  be  solved  using  ether  techniques?  A 
review  of  current  operations  research  publications  indicates  that  short 
range  problems  are  handled  by  resource  analysis  techniques,  however,  rcsourco 
analysis  is  essentially  the  same  as  systems  analysis.  The  only  difference 
between  these  analytical  approaches  is  that  cost  is  usually  not  the  most 
important  factor  in  the  short  run.  For  example,  it  might  be  demonstrated 
that  a  particular  alternative  is  much  cheaper  than  other  alternatives,  but 
personnel  ox*  special  material  requirements  of  this  alternative  might  nogato 
its  use  in  the  short  run. 

Continuing  Process  ' 

i  1 

It  has  been  asserted  that  systems  analysis  is  used  for  both  long  and 
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shore  range  problems.  Systems  analysis  is  n  continuing  effort  from  the 
concept  formulation  stage,  through  feasibility  testing,  through  all 
development  stages,  into  production  and  throughout  the  life  of  the  product 
or  the  idea.  At  each  stage,  information  which  is  both  more  pertinent  and 
more  reliable  becomes  available  to  the  analyst.  Since  the  analyst  is 
continually  acquiring  information,  the  decision  maker  or  a  member  of  his 
staff  must  maintain  close  contact  with  the  study  to  verify  that  the  current 
facts  and  assumptions  are  valid,  by  monitoring  each  phase  of  the  study, 
time  and  money  can  be  saved  because  the  manager  will  be  able  to  make  good 
timely  decisions  and  eliminate  alternatives  which  could  never  bo  implemented, 

Sir.co  systems  analysis  is  a  continuing  process  and  since  the  manager 
is  continuously  involved,  it  becomes  evident  that  present  decisions  may 
be  exactly  opposite  to  decisions  made  in  the  past.  This  is  natural  because 
as  time  passes  the  goals,  alternatives,  criteria,  and  environment  change; 
necessitating  a  complete  re- evaluation  of  the  entire  project. 

The  Computer 

Much  has  been  written  about  Robert  McNamara,  systems  analysis,  and 
computers.  Since  these  subjects  arc  often  discussed  in  the  same  article, 
the  reader  often  associates  systems  analysis  with  computers.  This 
•association  is  not  justified.  Systems  analysis  is  a  technique  while 
the  computer  is  a  tool  utilized  by  systems  analysts.  In  fact,  a  computer 
is  not  necessary  for  systems  analysis;  it  merely  speeds  calculations  which 
the  systems  analyst  has  determined  are  necessary  to  solve  the  problem. 

Once  the  analyst  has  determined  what  must  be  calculated  it  is  relatively 
easy  to  program  this  so  it  can  be  run  on  a  computer. 

Value  and  Use  of  Systems  Analysis 

Systems  analysis  is  a  tool  of  the  manager  which  enables  him  to  avoid 
broad  generalizations.  This  tool  is  used  by  the  manager  to  allocate 
resources,  to  optimize  under  a  particular  set  of  circumstances,  to 
compare  alternatives  and  to  establish  requirements.  In  comparing 
alternatives,  in  order  to  make  a  decision,  the  manager  is  interested  in 
differences,  not  similarities,  among  alternatives..  The  real  vaxuo  of 
systems  analysis  lies  in  the  fact  that  it  is  a  systematic  approach  which 
forces  a  manager  to  structure  his  thinking  to  the  problem  at  hand,  by 
forcing  differentiation  of  qualitative  and  quantitative  variables  and 
by  listing  the  assumptions,  techniques,  and  limitations  of  t:bo  study;  tho 
problem  areas  are  highlighted.  In  other  words,  at  this  point  tho  manager 
finally  knows  what  must  be  docidcd. 
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This  author  believes  that  the  present  day  manager,  who  most 
theorists  assume  is  interested  in  making  an  optimum  decision,  is  actually 
interested  in  eliminating  the  alternatives  which  could  prove  disastrous. 
Since  only  the  results  of  the  one  alternative  selected  by  the  decision 
maker  can  be  observed,  the  decision  maker  is  sitting  protty  if  ho  can 
avoid  obviously  poor  decisions.  The  reason  for  this  is  that  once  a 
decision  has  been  made,  even  if  the  best  alternative  has  not  been  selected, 
the  manager  can  make  this  solution  work. 

Another  advantage  of  systems  analysis  is  that  it  may  demonstrate  to 
the  manager  that  a  decision  may  be  postponed.  The  point  will  not  be 
belabored  that  choosing  to  do  nothing  is  a  decision.  If  a  decision  can 
be  postponed,  the  study  can  be  revised  to  take  advantage  of  more  accurate 
and  timely  information,  which  increases  the  usefulness  of  the  study.  In 
addition,  since  every  manager  operates  in  a  dynamic  environment,  this 
means  that  the  competition  has  less  time  to  react  to  the  decision.  This 
holds  true  when  possible  strategics  of  the  United  States  are  being 
considered,  when  a  manufacturer  is  engaged  in  negotiating  a  union  contract 
or  when  developing  optimum  organization  techniques.  The  importance  of 
delaying  a  decision  until  it  is  needed  is  evident  when  past  prognostications 
of  the  future  are  evaluated  against  reality. 

Cost-effectiveness  studies  are  also  a  good  source  of  documentation. 

The  subjects  which  should  be  discussed  in  Che  summary  of  the  cost- 
cf f ecti veness  study  (FIGURE  l)  enable  the  manager  and  future  users  to 
analyze  the  value  of  the  effort.  In  addition,  the  progress  of  a  study  can 
be  ascertained  by  determining  whether  or  not  the  steps  in  the  general 
methodology  (FIGURE  2)  are  being  followed. 

Limits  tions  of  Systems  Analysis 

Like  everything  else,  systems  analysis  has  its  limitations.  In 
systems  analysis,  the  real  world  is  represented  by  a  model.  Since  a  model 
is  one  level  removed  from  reality,  an  optimum  solution  to  the  problem,  as 
defined  in  the  model,  may  not  work  in  the  real  world.  Furthermore,  a  good 
systems  analysis  study  requires  a  great  deal  of  effort  which  means  that 
both  competent  people  and  the  necessary  time  must  be  available.  If  cither 
of  these  factors  is  missing,  the  resultant  effort  will  bo  cither  poor  or 
incomplete.  If  an  incomplete  effort  is  submitted  as  a  "systems  analysis 
study",  an  unearned  air  of  respectability  accompanies  tho  submission.  The 
false  confidence  inspired  by  this  incomplete  effort  may  lGad  to  poor 
decisions  in  Cr.o  future. 
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A  second  problem  arises  when  data  is  not  available  or  only  low 
confidence  vclv.es  can  be  placed  on  this  date.  The  value  of  good  relevant 
data  cannot  be  overstated.  Tito  last  factor  to  be  considered  is  the 
effect  of  a  good  decision  based  on  a  successful  study.  As  was  discussed, 
a  decision  is  valuable  for  a  certain  time  frame.  After  this  time  period, 
the  environment  changes  of  its  ova  accord  or  the  competition 'moves  to 
change  the  environment  so  that  another  '•ystoms  analysis  .If-rf  must  bo 
prepared  for  Lite  new  problem. 

General  Methodology 

Fortunately  for  systems  analysts,  no  cut  and  dried  method  of 
performing  these  studies  exists.  Each  problem  is  different,  each 
environment:  is  different  and  the  techniques  of  systems  analysis  are 
constantly  changing,  The  problem  tel Is. -the  system  analyst  the  direction 
to  follow,  For  these  reasons  it  is  easy  to  see  that  the  systems  analyst 
must  be  both  ingenious  and  flexible,  but  it  also  seems  reasonable  that 
some  way  should  bo  developed  to  take  advantage  of  any  similarities.  For  • 
this  reason,  a  general  methodology  (FIGURE  2)  has  been  developed.  Each 
of  the  steps  in  the  methodology  will  now  be  discussed. 

befinine  the  Problem 

As  has  often  boon  said,  defining  the  problem  is  the  most  important 
part  of  any  study  effort.  If  the  problem  is  not  clearly  defined  and  the 
scope  of  the  effort  spelled  out,  interface  problems  and  suboptimization 
may  result. 

Problem  definition,  which  should  therefore  be  the  first  part  of  any 
study,  begins  with  some  statement  of  general  objectives,  such  as,  "this 
Army  will  have  the  best  possible  communications"  or  "this  company  will 
operate  so  that  each  person  receives  quality  merchandise  and  good  service 
for  a  reasonable  amount  of  money".  These  abstract  goals  must  now  be  turned 
into  specific  realistic  requirements  which  is  extremely  difficult  in  practice. 
The  first  question  encountered  deals  with  the  scope  of  the  problem.  Do 
we  mean  that  we  will  provide  communications  under  all  possible  conditions? 

How  is  communications  defined?  What  do  we  mean  by  the  "best  possible" 
conmunications?  In  considering  the  business  concern,  how  do  we  define 
quality  and  good  service,  what  is  a  reasonable  amount . of  money,  and  are  wo 
talking  about  all  products  vo  sell  or  only  thoso  which  we  produce  and  sell? 

During  this  translation  of  the  abstract  to  the  realizable  goal,  the  . 


decision  maker  must;  participate  because  all  alternatives  will  be  evaluated 
against  this  requirement.  This  aspect  of  the  methodology  assumes  greater 
importance  when  it  is  remembered  that  certain  aspects  of  systems  operation 
can  be  improved  without  improving  the  overall  efficiency  of  the  system. 
Furthermore,  if  the  requirements  are  set  too  high,  the  system  may  be 
cwrd^igned.  Even  though  overdesign  increases  the  cost  and  effort  involved 
in  product  development,  the  initial  phase  of  problem  definition  is  often 
summarily  concluded.  To  avoid  this  problem,  both  minimum  and  maximum 
requirements  should  be  set.  Specific  requirements  are  often  expressed  in 
terms  of  quantitative  standards,  but  qualitative  requirements  arc  often 
forgotten.  Representative  qualitative  requirements  must  be  developed  and 
should  be  listed  separately  from  the  quantitative  requirements.  For  example, 
requirements  for  personnel  with  certain  skills  and  special  time  constraints 
must  be  spelled  out. 

Since  these  requirements  arc  to  be  used  for  evaluation,  it  is 
important  that  no  alternatives  arc  precluded  by  the  definition  of  tho 
problem.  Tho  different  levels  of  problem  definition  must  be  considered. 

For  example,  if  one  radio  is  simply  to  be  cor, .pared  against  another  radio 
for  communication  over  a  certain  distance,  it  is  relatively  easy  to  develop 
a  requirement  for  this.  Note  how  problem  definition  becomes  more  difficult 
ns  the  radio  is  compared  with  another  means  of  communication  such  as  cable 
to  determine  vhich  provides  the  best  communication.  Now  expand  the  problem 
so  that  you  compare  this  radio  versus  an  improved  weapon  to  determine  when 
overall  combat  effectiveness  has  improved.  In  order'  to  take  into  account 
all  state-of-the-art  advances,  and  to  guax-d  against  overdesign,  a  significant 
amount  of  time  should  be  spent  defining  the  problem. 

Defining  the  Environment  and  the  Mission  Mix  ■ 

For  a  product  to  be  profitable,  the  proper  market  for  this  product 
must  be  determined .  Similarly  if  a  weapon  system  is  to  be  effective,  it 
must  be  able'  to  meet  a  certain  threat.  However,  the  extent  of  the  value  of 
this  weapon  system  also  depends  on  how  often  the  threat  materializes. 

For  those  reasons,  it  is  evident  that  systems  analysis  cannot  be  performed 
in  a  vacuum.  The  conditions  under  which  the  system  will  operate  and  the 
number  of  times  this  system  is  needed  must  be  defined. 

If  the.  objectives  are  to  be  realized,  a  clearly  defined  mission  mix  must 
bo  provided.  The  typo  of  mission  and  the  frequency  of  occurrence  of  each 
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mission  Must:  be  do term i nod .  Although  this  appears  obvious,  a  review  of 
many  systems  analysis  studies  shows  that  it  may  not  be  so  obvious.  For 
example,  real  time  computer  capability  is  extremely  advantageous  to  a 
manager.  With  such  a  system,  a  manager  could  develop  n  program  so  that  ho 
could  receive  an  immediate  printout  on  the  background  cf  each  employee. 
However,  how  often  does  the  manager  need  this  information  immediately?  Vhat' 
percentage  of  the  personnel  decisions  which  a  manager  makes  require  immediate 
information?  Granted  the  manager  has  received  information  faster,  but 
has  he  increased  the  cffecti ver.ess  of  the  personnel  system?  Another 
example  of  this  concept  is  the  development  of  a  system  which  is  to  perform 
two  or  more  functions.  To  develop  the  best  system  the  relative  need  for 
each  function  must  be  an own . 

If  the  environment  is  to  be  realistic,  close  attention  must  be  given 
to  the  time  factor,  If  a  product  is  needed  in  four  years  but  development 

of  the  item  requires  eight  years,  it  would  be  a  waste  of  time  to  develop 

tiie  original  item.  The  operational  situation  must  be  timely.  It  must 
reflect  the  conditions  under  which  the  product  will  be  utilized.  Furthermore, 
if  the  product  is  to  operate  over  a  certain  period  of  time,  provision  for 

change  must  bo  built  into  the  environmental  section  of  the  study.  If  a 

product  has  a  life  cycle  of  ten  years  and  requires  eight  years  to  develop, 
the  scenario,  which  provides  background  information,  should  reflect  the 
-conditions  eight  years  from  now  to  eighteen  years  in  the  future.  State- 
of-the-art  advances  must  bo  considered. 

Suppose  all  the  above  factors  have  been  considered,  one  factor  still 
remains.  How  are  these  missions  to  be  weighted  relative  to  one  another? 

One  thing  is  certain,  all  missions  will  not  have  the  same  amount  of  importance 
therefore,  if  an  optimum  product  is  to  be  developed,  weights  must  be 
assigned  to  each  mission.  V-Tio  assigns  those  weights?  One  of  the  better 
methods  of  assigning  relative  values  is  to  bring  together  a  number  of  experts 
with  different  backgrounds.  These  experts,  without  benefit  of  discussion,  are 
then  asked  to  rank  the  missions  in  order  of  importance.  After  listing 
these  missions  in  order  of  importance,  the  five  or  six  most  important 
missions  arc  considered  by  the  group.  Since  these  five  or  six  missions 
will  probably  cover  90%  of  all  missions,  the  experts  then  assign  percentage 
values  to  each  of  these  missions.  After  normalising  those  figures,  a 
relative  mission  mix  will  have  been  developed.  This  mix  provides  a 
beginning.  In  the  analytical  section  of  the  methodology,  it  will  bo 
demonstrated  hoi/  this  relative  mission  mix  can  be  easily  modified  or 
other  missions  added  to  determine  the  effect  on  tho  outcome  of  tha  study. 


7 


Dcvol  oping  the  fritcria 


I 

i 


The  criteria  is  an  approximation  of  the  objective.  It  serves 
ns  the  standard  against  which  the  alternatives  arc  compared .  Since 
there  are  many  types  of  objectives,  there  will  be  many  types  of  criteria. 

For  example,  a  go/no  go  criterion  is  valid  for  some  types  of  studies  while 
decrees  of  success  must  be  considered  in  other  studies.  The  problem 
indicates  to  the  study  group  what  type  of  criteria  to  develop. 

In  many  cases,  subjective  considerations  become  the  critical  factors 
in  the  selection  process.  For  example,  how  will  morale  or  coordination 
be  affected  by  each  alternative?  Since  It  is  obvious  that  each  person 
will  weight  these  factors  di ffcrontly ,  they  should  be  listed  as  factors 
affecting  the  decision.  (Note  how  these  factors  differ  from  the 
qualitative  requirements  discussed  previously.)  One  other  way  of  handling 
those  qualitative  factors  might  be  considered.  A  group  could  be  set  up 
to  apply  quantitative  values  to  each  qualitative  factor.  The  major  short¬ 
coming  of  this  approach  is  that  these  quantitative  estimates  of  qualitative 
factors  must  now  be  combined  with  pure  quantitative  factors. 

The  criterion  is  usually  expressed  in  the  following  manner:  provide 
the  same  level  of  effectiveness  for  all  alternatives;  then  select  the  one 
with  the  least  cost  or  vice  versa.  As  can  be  imagined,  this  comparison 
c..n  be  performed  for  many  different  cost  or  effectiveness  levels  and 
different  results  will  probably  be  obtained  at  cod  level.  Since  this 
doesn't  help  the  decision  maker,  maximum  and  minimum  standards  for  cost  and 
effectiveness  should  bo  developed  to  reduce  the  scope  of  the  problem  and 
incremental  analysis  techniques  should  bo  used  to  show  when  the  cost  of 
add  Vional  effectiveness  becomes  prohibitive.  After  utilizing  these  aids 
n.  developing  quantitative  measures  of  effectiveness,  the  qualitative 
factors  or  subjective  considerations  often  become  the  deciding  factor. 

»  ' 

Having  considered  beth  cost  and  of foe  ivencss  (the  derivation  of  tho 
name  cost-effectiveness  study),  it  would  appear  logical  to  develop  a 
cost-effectiveness  ratio.  However,  such  a  ratio  is  misleading  for  the 
following  reasons:  (l)  the  cost  of  an  item  depends  on  the  quantity  produced 
therefore,  the  C/£  ratio  will  vary  depending  on  the  amount,  (2)  tho  ratio 
is  affected  by  changes  in  cither  the  numerator  or  tho  denominator,  (3)  tho 
level  of  effectiveness  stay  not  reach  the  minimum  level,  yet  a  good  ratio 
could  exist.  The  first  two  problems  can  be  eliminated  if  either  cost  or 
effectiveness  is  held  constant  aid  the  development:  of  a  minimum  standard . 
will  eliminate  the  third  problem.  Therefore,  a  C/L  ratio  can  be  useful  if 
tho  criteria  standards  discussed  above  are  implemented. 


To  conclude  Lius  section,  importance  factors  will  be  discussed. 

Tile  importance  fa ;Lor  is  the  value  of  one  system  parameter  relative  to 
oilier  parameters ,  This  concept  is  easily  understood  it  it  is  recoiled 
that  effectiveness  depends  on  a  number  of  tilings,  For  example,  the 
effectiveness  of  n  plane  is  dependent  upon  speed,  range,  maneuver.'ibi  1  i  ty , 
availability  and  many  other  factors,  but  how  are  those  factors  related  to 
overall  effectiveness?  Docs  speed  contribute  30‘A  to  total  effectiveness? 

Is  speed  twice  as  important  as  range?  This  weighting  problem  was  discussed 
earlier  in  the  paper  and  the  use  of  a  group  of  experts  to  develop  these 
importance  factors  still  appears  to  be  tl.o  Most  promising  solution.  After 
the  study  has  been  completed,  a  senriti  ,'ity  analysis  can  be  run  on  each 
factor  to  determine  how  it  affects  the  results  of  the  study, 

Detorii'l  i l  nr  the  A  i  Vf-?~nat  i  vos 

Having  defined  the  p-  ’•lo;n  and  developed  the  selection  criteria,  all 
alternatives  which  may  cal.sfy  the  requirements  should  be  listed.  The 
proble;. i  must  be  stated  in  general  ter...;,  so  that  no  alternatives  are 
precluded,  Ingenious  people  v.’ith  bread  backgrounds  must  determine  those 
alternative:.,  for  only  then  can  the  decision  maker  be  certain  that  all 
alternatives  have  been  considered. 

In  addition,  vho  internal  and  extern, ;1  tradeoffs  for  each  alternative 
must  be  considered,  For  example,  if  the  objective  is  to  destroy  an 
enemy  position,  combat  troops  May  be  aided  by  either  tactical  air  support, 
ground  fire  support,  or  .a  combination  of  the  two.  hut  many  types  of 
air  and  ground  fire  support  exist.  For  Instance,  tanks,  artillery, 
mortars  and  vehicular  mounted  weapons  provide  ground  fire  support  and 
each  of  these  categories  can  be  further  divided.  Artilioty  could  bo 
divided  into  1 0f>;. ca  guns,  133;.m  guns,  and  173;., m  guns.  Once  a  weapons 
system  has  been  selected,  its  effectiveness  can  bo  changed  by  varying  Its 
performance  or  its  availability  characteristics,  Availability  is  determined 
by  intrinsic, availability  and  operational  availability,  and  intrinsic 
availability  is  dependent  upon  reliability  and  maintainability. 

As  illustrated  above,  differences  in  degree  and  in  kind  exist  at 
each  level  of  the  system. 

Dotor, ni  nr  the  jvn.lj.vajnt  V,', ri  1,1  o y, .  Assur.mi  j  ons  and  Facts 

Duo  to  cultural  and  educational  differences,  the  sar„o  word  can  have 
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many  different  Meanings,  Not  only  % / ill  people  disagree  on  the  definition 
of  a  word  but  they  will  disagree  on  the  importance  of  tho  concept  which 
tho  vord  represents.  Since  these  concepts  have  not  been  universally  defined, 
it  becomes  even  more  difficult  to  measure  thorn.  Therefore,  each  concept 
and  characteristic  must  be  explicitly  defined  if  a  cost- effectiveness  study 
is  to  be  meaningful. 

Since  a  study  is  conducted  to  deton, lino  solutions  to  an  existing 
problem,  a  clear  differentiation  must  Tic  made  between  assumptions  and 
facts  and  each  assumption  and  fact  must  be  listed  for  the  decision  maker. 

In  addition,  the  source  of  each  fact  and  the  reason  for  each  assumption  should 
be  noted.  Only  in  this  way  can  tho  decision  maker  check  the  reasonableness 
of  the  study  and  ascertain  if  the  real  problem  is  being  attacked. 

Tho  factors  which  will  make  up  the  effectiveness  value  are  then 
selected  by  a  group  of  experts.  To  do  this  all  factors  which  are  thought 
to  affect  the  effectiveness  value  are  determined.  After  structuring 
those  variables  according  to  importance,  the  six  most  pertinent  are 
selected.  The  reason  for  selecting  six  variables  is  that  the  author 
believes  that  90'/.  of  total  effectiveness  is  determined  by  these  variables. 

If  this  surmise  is  v:rong,  no  damage  hr, s  been  done  because  the  effect  of 
other  variables  may  be  tested  by  sensitivity  analysis.  After  selecting 
these  variables,  tho  group  of  exports  assigns  v, ’eights  to  these  factors. 

These  variables  must  bo  chosen  so  that  any  significant  change  to  tho 
system  will  be  immediately  evident  in  tho  model  results. 

Ccnorat 1 nt  tho  Data 

At  this  stage  of  the  study  plan,  tho  problem,  criteria,  and  alternatives 
will  have  been  defined  and  tho  problem  will  indicate  to  the  study  group 
what  data  is  needed.  Data  is  needed  on  both  the  cost  and  effectiveness 
aspects  of  tho  study,  but  the  necessary  data  in  the  proper  form  is  difficult 
to  obtain,  ’Ever,  though  tho  time,  effort  and  cost  involved  in  gathering  data  i 
high,  confidence  in  the  validity  of  tho  data  i;  often  low.  There  is  no 
simple  solution  to  this  problem,,  and  a  number  of  articles  have  been 
written  or.  data  collection,  but  it  should  again  be  stressed  that  a  study  will 
not  be  successful  unless  a  sufficient  amount  of  money  and  talent  aro 
committed  to  this  step. 

Dcvcj on  1  nr  the  Model  1 

It  becomes  obvious  in  this  section  that  model  develop, meat  and  data 


generation  shoal  d  enko  place;  concurrently  because  a  coni  i  ituous  feedback 
loop  exists  between  those  2  phases.  Clone  A.  Marled  defines  a  Model  as 
follows,  "A  model  is  a  representation  of  a  thin";  the  wore  ii-uporfniit  parts 
of  the  real  thin;;  a  re  incorporated  into  the  nod-el,  and  appropriate  analogs 
arc  used  to  replicate-  essential  structural  and  functional  characteristics." 
lhc  nodcl  abstracts  only  those-  parts  which  are  important  to  the  problem, 
this  iiic-ans  that  no  Model  is  completely  realistic,  because  many  intangibles 
and  concepts  which  are  difficult  to  define  arc-  neglected.  However,  the 
value-  of  a  Model  depends  on  its  ability  to  indicate  the  merit  of  various 
al tenia t i vor. ,  not  on  how  accurately  the  model  is  a  reproduction  cf  the 
real  v.orld.^ 

Any  Model  chosen  must  illustrate  the  tradeoffs  between  effectiveness 
gained  and  resources  utilized.  For  this  reason,  effectiveness  and  cost 
submodels  are  developed.  The  effectiveness  submodel  is  divided  into 
pox- for.,;.. nee  and  availability  submodels,  and  the  cost  model  is  broken  into 
research  and  devol  optic-id:,  initial  investment,  and  operating  and  maintenance) 
submodels  (FICl'JkES  3,  /,  &  f>).  Each  of  these  submodels  is  further  divided 
into  its  element:;  as  illustrated  in  the  area  communications  example, 

V.'lu,t  this  means  is  that  just  as  a  system  is  a  hierarchy  of  subsystems,  so  a 
model  is  a  hierarchy  of  submodel s  whore  each  submodel  is  composed  of  a  number 
of  a  1  tori  thus.  Furthermore,  just  as  subsystems  must  be  integrated  into 
the  system  so  must  submodels  be-  integrated  into  the  model.  Tins  is  a 
difficult  fas!:  for  the  model  builder  who  must  develop  and  interface  c-ach 
level  of  the  Ji.odc]  . 

Modular  design  is  the  tool  which  enables  the  designer  to  build  a  multi¬ 
level  model.  In  a  modular  model,  Cite  failure  of  an  element  on  a  certain 
love-1  does  not  affect:  other  elements  cm  Lhc  same  level.  Inis  concept 
enables  the-  system  designer  to  localize  cause  and  effect  relationships,  - 
As  utopi.-.n  as  this  idea  sounds,  it  does  not  i'.cld  co...ploLojy  true  in  the-, 
design  oi  a  model  because  submodels  arc  not  independent  of  c-ach  other.  - 
Therefore,  the-  relationship  of  each  element  to  other  elements  and  to  tho 
next  higher  level  must  be  clearly  defined.  This  is  extremely  difficult. 

The  amount  of  detail  lit  each  submodel  and  the  degree  of  detail  to  which  the 
interfaces  arc-  stated  is  dependent  upon  the  time,  money  and  expertise 
available.  Expertise  is  the  greatest  limiting  factor. 

It  in  easy  to  see  that  continual  feedback  is  neccssnx*y  Sn  model 


G.  A.  Marke-l ,  "A  Concept  for  Modeling  and  Evaluating  I nfoi-(na Lion- 
Producing  Systems,"  bI)C  publication  A)>  626696  (January  1.966),  p,  6. 
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development: .  Each  submodel  is  relit  Cod  to  the  model  and  other  submodels 
and  a  continuous  exchange  of  ideas  is  necessary  so  that  a  complete 
description  of  all  interface  nlgori thine  is  developed.  In  addition,  tiic 
decision  junker  must  be  continually  briefed  because  he  will  be  called  upon 
to  provide  further  guidance  for  submodel  developers  and  to  insure  that  the 
correct  problem  is  still  being  attacked  by  the  ir.edel  builder. 

Effectiveness  Model 

Having  introduced  the  concept  of  modular  design  cf  submodels,  the 
effectiveness  and  cost  models  will  now  be  discussed.  An  overview  of  these 
models  is  shown  in  figure  ?..  Many  different  groups  have  developed  methods 
of  estimating  effectiveness.  The  '.'capons  System  Industry  Advisory  Committee 
(WSIAC)  ap  pears  to  have  been  the  first  group  to  establish  a  method  of 
establishing  effectiveness.  To  determine  systc-m  effectiveness,  this  group 
used  a  matrix  concept  which  represents  effectiveness  in  terms  of  capability, 
'availability,  and  dependability  of  the  equipment .  It  appears  that  a 
simpler  method  of  determining  effectiveness  exists.  Total  effectiveness 
is  determined  by  manipulation  of  the  performance  and  availability  submodels. 

Performance  Model 

There  are  no  general  elements  which  1  can  gr<up  under  this  heading 
because  each  problem  has  different  measures  of  performance,  for  example, 
speed  and  maneuverability  are  extremely  important  when  considering  the 
measure  of  performance  of  an  interceptor  airplane,  however,  they  arc  of  no 
concern  when  considering  the  measures  cf  performance  of  a  manpack  radio. 

The  problem  indicates  the  important  parameters  'ad  an  example  of  this  is 
provided  in' the  area  communi cat  ions  example.  (Appendix  l) 

Availability  Model 

■  :  'I 

It  is  much  easier  to  develop  a  general  model  of  availability.  As  can 
be  seen  from  figure  A,  availability  is  dependent  upon  two  primary  factors, 
intrinsic  availability  and  operational  availability.  Availability  is  the 
probability  that  the  system  is  able  to  function  satisfactorily  at  any  point 
in  tiiiie  when  used  under  stated  conditions,*  where  the  total  time  considered 
includes  operating  time  and  repair  time.  (Repair  time  is  further  divided 
into  active  repair  time,  administrative  time  and  logistics  time.)  Intrinsic 
availability  is  a  function  of  reliability  and  maintainability  only.  As 
can  be  imagined,  the  best  way  to  improve  the  availability  of  equipment  is  to 
incron  so  intrinsic  availability,  'inis  can  be  achieved  only  if  a  major 
reliability  and  ton  into  inability  effort  is  begun  early  in  the  design  stage. 
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The  oilier  major  fa  dor  influencing;  ava  i  lab; 1  i  ry  is  operational, 
ava  5  lab;  1  i  ry.  Tron  figure  4,  it  can  be  seen  that  two  primary  factors 
determine  operational  availability.  Those  two  factors  arc  attrition  re to 
and  repair  time.  Repair  time  is  deter;. lined  by  serviceability,  logistic 
timc>,  nclmini  strati ve  time,  and  failure-  rate.  .  - 

Undoubtedly,  the  reader  is  happy  to  know  the  factors  which  determine 
availability,  but  he  would  probably  bo  happier  if  the  interrelationships 
were  shown.  Three  levels  of  detail  arc  shown  in  the  availability  model. 
Algori  lir.;;;  must  bo  developed  which  show  how  elements  are  combined  to 
form  submodels  and  how  submodels  are  combined  in  the  model,  Tor  example, 
design  reliability  and  design  maintainability  are  combined  to  give  the  vaiuo 
of  intrinsic  availability.  Intrinsic  availability  and  operational 
availability  are  now  combined  to  give  a  measure  of  availability. 

Since  submodels  are  not  independent  of  other  submodels,  additional 
algorithms  must  be  generated  which,  show  these  relationships.  Tor  example , 
design  maintainability  is  a  determining  factor  of  availability,  but  it 
also  affects  repair  time. 

Coat:  Model 

The  life  cycle  costing  concept  considers  KfJl,  initial  investment, 
and  operating  and  maintenance  costs  ever  the  total  useful  life  of  the 
system.  In  the  P.M>  category,  all  stages  of  development  should  be  considered 
Figure  5  illustrates  the  basic  pn Ci  .j o.>  Oi  development  in  the  R4I)  cycle. 

The  Kf<ll  cycle  begins  with  the  exploration  development  stage  in  which  the 
feasibility  of  a  product  is  tested,  and  ends  with  operational  systems 
development.  During  the  development  phases,  various  systems  development 
approach.es  arc  evaluated  and  the  best  approach  selected  and  implemented. 

The  costs ’which  are  found  in  each  of  these  stages  have  been  examined  in 
detail  and  many  ohc-c>:  lists  have  been  developed. 

The  investment  costs  involve  all  costs  expended  to  manufacture  a 
product,  A  summary  of  the  major  elements  is  given  in  figure  5.  In 
this  phase,  the  costs  of  production  facilities,  labor,  £.nd  materiel  are 
considered.  Production  testing  and  quality  assurance  costs  are  also 
considered  hc.ro.  Two  other  high  cost  factors  are  the  cost  of  the  initial 
supply  of  repair  parts  and  tho  cost  of  government  furnished  equipment. 

Tho  last  cost  category  is  operating  and  maintenance  costs.  Operating 

-  '  '  > 
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cost:s  and  inn intenance  cost;;  provide  the  bulk  of  these  costs.  The  other 
major  factors  arc  personnel  and  training  costs,  and  supply  operations 
costs.  An  example  of  the  cost  of  supply  operations  is  the  cost  associated 
with  running  a  depot  or  maintaining  a  headegaartorc . 


Each  of  these  submodels  has  been  extensively  describ 


ii  1  itnry 


Standard  8S1,  which  has  not  been  approved,  provides  the  standard  EOl) 
work  breakdown  structures  for  eight  types  of  hardware  systems  and  defines 
which  costs  fit  into  each  category.  In  addition,  completed  cost-offcotivonoss  . 
studies  provide  further  documentation. 

Having  determined  the  cost  categories  to  be  used,  the  remaining 
problem  is  to  gather  the  costs.  Since  most  studies  arc "performed  on 
systems  in  the  experimental  stage,  it  is  soon  discovered  the t  no  cost 
information  is  available.  This  moans  that  a  relationship  between  the 
desired  cost  and  son i  known  physical  or  performance  characteristic  of  the 
system  must  be  found,  Then  an  algorithm  is  developed  which  relates  cost  to 
the  value  of  this  character i st i c .  For  example,  the  Air  Force  has  effectively 
used  aircraft  weight  to  predict  airframe  cost  and  recently  a  relationship 
has  been  found  between  truck  weight  and  fuel  consumption.  In  these  eases, 
regression  analyses  wore  performed  on  historical  data  from  existing  similar 
systems.  Regression  analysis  is  a  statistical  technique  which  illustrates 
mathematically  the  relationship  between  two  or  more  variable:  and  assigns 
confidence  levels  to  those  relationships.  After  production  costs  are 
estimated,  learning  curve  theory  shows  how  these  production  costs  decrease 
as  experience  is  gained. 

There  are  other  factors  to  be  considered  while  gathering  costs, 
basically,  the  costs  which  are  the  same  for  all  alternatives  (fixed  costs) 
are  only  valuable  for  determining  whether  the  cost  ceilings  have  been 
pierced.  In  addition,  all  money  that  has  been  obligated  or  spent  is 
a  sunk  cost  and  should  not  bo  considered  because  systems  analysis  can 
demonstrate 'when  past  decisions  should  be  changed,  but  it  cannot  bring  this 
money  back.  Since  the  objective  of  the  study  is  to  select  the  best  alternative, 
only  costs  which  are  different  for  each  alternative  should  be  considered. 

This  is  differential  cost  theory. 

There  'are  certain  military  policies  such  as  procur  OmiCTiL  ti II G 
overhaul  policies  which  K.ust  be  considered  when  designin';  the  overall 
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cost:  equation.  The  problem  fells  the  analyst  how  fo  combine  ell  relevant: 
costs,  Tor  example,  a  £  on  oral  unit  life  cycle  cost  for  a  eysto.v  would 
follow  LftiS  fOfin  : 


UNIT  COST 


RtiJ)  costs  ■*'  initial  i nvosf meat  •)  life 
eve')  a  ow’V- ti  nj;  and  n i  ntcr-nce  costs 
. . .  : .  N  .  . . 


(v.’horc  N  is  tiio ) 
(number  of  units) 


Algorithms  must  be  developed  to  relate  all  elements  in  each  category. 
As  soon  in  Tigurc  $,  the  total  TA;>  cost  is  found  by  adding  exploratory 
development,  advanced  development,  engineering  development  and  operational 
systems  development  costs. 

Another  el  or, lent  to  bo  considered  is  that  the  value  of  money  changes 
with  time.  This  can  bo  seen  by  cheering • the  interest  you  have  received 
in  the  past  year.  Since  the  norma  1  life  cycle  of  a  system  is  approximately 
ten  years,  different  amounts  of  money  will  be  spent  during  each  year  of  the 
life  cycle.  If  two  alternatives  have  the  same  effectiveness ,  but  one 
requires  a  largo  initial  investment  while  the  cost  of  the  other  is  spread, 
equally  over  a  number  of  years,  the  second  alternative  is  cheaper.  How 
much  cheaper  depends  on  the  discount  rate  .assigned  for  the  study.  This 
issue*  lias  genera  tod  a  lot  of  controversy  because  no  two  people  .agree  on 
the  discount  rate  to  be  utilised  or  on  the  estimates  useful  life  of  the 
product.  To  solve  this  problem  a  number  of  discount  rates  should  bo  used 
and  the  effect  on  total  cost  evaluated. 


Exercising  the-  Node! 

After  tiio  model  has  been  developed,  it  must  be  manipulated  to  provide 
information  on  each  alternative.  If  the  problem  in  simple  the  manipulation 
can  bo  done  by  hand,  otherwise  a  computer  is  utilised.  Simulation  is  often 
utilised  in  systems  analysis  because  it  provides  quantitative  answers  to 
specific  questions  which  do  not  require  the  participation  of  a  decision  maker 
The  great  time  compress- ions  and  control  conditions  obtainable  with  computer 
Simulation  provide  data  which  is  useful  for  more  quantitative  and  rigorous 
analysis.  This  time  compression  is  due  to  the  fact  that  either  probabilistic 
or  deterministic  decision  rules  arc  smitten  into  the  s insulation.  The 
problems  that  are  best  studied  by  computer  simulation  arc  those  which 
require  largo  p.-.inplo  sir.es  in  order  to  perform  adequate  statistical  tests. 

To  gain  tho  most  from  the  use  of  simulation,  the  program  must  bo 
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written  so  that  the  variation  of  the  critical  parameters  car.  bo  cosily 
detected.  If  parameters  become  less  important,  they  arc  modelled  ns 
environmental  conditions.  However,  ns  a  variable  becomes  a  limiting 
factor  in  the  results,  it  is  modelled  in  more  detail. 2  The  model  is 
continually  being  modified  because  data  may  not  be  available,  because 
additional  knowledge  indicates  that  so.r.o  data  may  not:  bo  relevant,  or 
because  some  parameters  become  less  critical  to  the  analysis. 

As  with  other  computer  programs,  the  cost  of  designing  and  running 
the  simulation  is  proportional  to  the  length  of  the  program  and  the 
complexity  involved. 


In  this  stage,  all  alternatives  are.- compared  against  the  standard  and 
against  each  other.  Three  levels  of  analysis  should  be  performed  in  any 
cost-effectiveness  study.  The  initial  analysis  should  be  general  in  nature' 
and  is  designed  to  eliminate  all  alternatives  which  cannot  moot  the  minimum 


requirements  or  the  cost  ceilings.  Kext,  an  intensive 


lysis  is  pcrroriiico 


in  which  detailed  cost  and  effectiveness  estimates  for  cash  remaining 
alternative  are  developed.  At  this  point,  some  additional  alternatives 
will  probably  be  eliminated.  An  incremental  analysis  (marginal  analysis) 
is  then  performed  on  the  remaining  alternatives.  This  analysis  will  show 
any  break-poi nts  which  may  exist.  Since  the  additional  effectiveness  for 


a  fixed  amount  of  investment  will  mar he 


beyond  this  point,  this 


test  provides  another  indication  as  to  which  alternative  should  be  selected. 
The  results  and  confidence  coefficients  for  the  detailed  analysis  and  the 
incremental  analysis,  along  with  subjective  considerations  should  now  bo 
presented  to  the  decision  maker. 

Sensitivity  Analysis  , 

Even  though  he  has  continually  participated  in  the  conduct  cf  the  study, 
the  deci  si  or.  maker  may  be  plagued  by  a  series  of  "what  if"  questions. 

Since  data  is  generated  with  different  levels  of  confidence  and  since  the 
use  of  expert  judgment  was  utilized  extensively  in  this  methodology  the 
manager  must  bo  provided  with  some  type  of  validity  check.  A  sensitivity 
analysis  provides  this  check  and  helps  to  eliminate  some  uncertainty.  In 
sensitivity  analysis,  certain  variables  or  environmental  factors  arc 
changed  so  that  the  effect  on  die  results  may  be  determined.  Using  this 
type  of  analysis,  the  contribution  of  each  variable  to  total  effectiveness 
can  be  determined.  The  importance-  of  a  sensitivity  analysis  in  the 
systems  analysis  effort  cannot  bo  overstressed.  This  technique  provides  the 


K.  A.  Goisler,  "Man-Machine  Simulation  Experience,"  Rand  publication 
,'i’3214  (August  196b),  p.  5. 
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means  of  changing  assumption's,  vary  in"  decision  ru]  c-s ,  modifying 

envi vonv.on  tn  1  conditions  and  considering  the.  reaction  of  the  competition. 

If  the  study  were  not  structured  so  that  sensitivity  analyses  could  bo 
performed,  the  study  would  be  useful  for  only  one  set  of  assur.pt i ons  and 
environmental  conditions.  Since  the  world  is  changing  rapidly,  the 
results  of  the  analysis  would  be  outdated  by  the  time  the  study  was  completed. 

Each  submodel  should  he  developed  so  that  mathematical  programming 
teenni ques  can  be  Uuil  ixed.  i o  use  n.i> ..iivi-.. t i c.i ^  je a » i  oo^C'Ctivo 
function,  mathematical  function,  and  the  constraints  and  restrictions 
on  variables  -..vast  be  defined.  Mathematical  programmi r.g  techniques  enable 
the  analyst  to  optimise  under  certain  restrictions  which  is  exactly  what 
vo  are  trying  to  accomplish  with  a  systems  analysis  study.  Mathematical 
programming  techniques  make  it  easier  tor  perform  sensitivity  analyses. 

The  concept  of  sensitivity  analysis  becomes  even  more  valuable  when  it 
is  recalled  that  the  specific  requirements  which  v:o  have  satisfied  are 
only  an  approximation  of  the  objective.  Thus,  sensitivity  analysis  enables 
us  to  determine  if  the  proper  problem  was  solved.  Sensitivity  analysis 
also  enables  us  to  determine  maximum  capabilities  under  fixed  conditions. 

This  is  simply  a  modification  of  the  basic  technique  in  which  time, 
materiel  or  personnel  requirements  act  as  a  limiting  factor  in  the  short 
run.  In  all  cases,  systems  analysis  should  be  conducted  for  both 
the  most  important  and  the  most  prevalent  conditions.'  The  question  of  what 
to  vary  and  horn  much  to  vary  must  ba  considered  because  of  the  cost  of 
the  additional  runs  required  for  sensitivity  analysis.  Since  the  cost 
varies  with  the  number  of  variations  mm,  an  experienced  analyst  must 
decide  which  parameters  arc  to  be  varied  and  what  degree  of  variation  is 
needed. 

Presenting  the  Results 

The  results  of  the  study  must  be  perfectly  clear  and  understandable, 
because  only  this  finished  product  is  transmitted  through  the  different 
levels  cf  management.  The  elements  which  should  be  contained  in  the 
final  report  are  shown  in  figure  1.  In  order  to  make  certain,  that  those 
factors  are  clearly  discussed,  the  final  report  should  contain  a  short  summary 
which  considers  each  of  those  elements.  Since  the  report  contains  two 
levels  of  detail,  the  reader  can  first  read  the  summary;  then  turn  to  the 
detailed  discussion  of  the  parts  that  interest  him. 

Two  point's  should  now  be  made.  In  the  section  in  which  the  results 
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Cl  the.  study  cf j. on  are  presented ,  the  Lenoiits  of  the  selected  alternative 
should  be  discussed  and  possible  problem  areas  highlighted.  Since 
soir.o  controversy  exists  about  vuethor  or  not  recommenda t  ‘  ons  should  be 
included  in  the  final  report,  it  is  shown  in  the  figure  as  an  optional 
section.  .  . 


Cone!  1 1 si  on s 

1  n  this  pa  pc  .. ,  1 i 1  e  na  tu ..  c ,  value,  ana  1 1  m  i  ta  1 1  ons  or  systoris 
analysis  were  discussed,  a  general  purpose  methodology  developed,  and 
tnis  methodology  applied  to  an  area  cowm'iuiii  cat  ions  problc-n.  In  addition, 
the  continuing  nature  or  systems  analysis  and  the  requirement  for  the  close 
participation  of  the  decision  mater  has  been  stressed.  Systems  analysis 
provides  answers  to  two  types  of  questions.  In  the  first  type,  a  certain 
level  of  ef feet i vcncss  is  required  and  the  alternative  selected  is  the  ono 
which  costs  least,  bystems  analysis  is  also  used  to  determine  the  worth 
of  additional  capability. 

Systems  analysis  was  defined  as  a  systematic  approach  to  problem 
solving  which  utilii.es  quantitative  management  science  techniques  to  develop 
and  evaluate  a  spectrum  cf  solutions  to  long  range  problems.  However,  this 
concept  can  be  applied  to  snort  run  problems  if  it  is  recalled  tliat  time  or 
personnel  considerations  in  ay  bo  more  important  than  money  in  the  short  run. 
Since  a  system  is  composed  of  men,  machines,  and  materiel;  a  careful 
differentiation  between  the  system  and  the  environment  is  necessary. 

Systems  analysis  is  valuable,  not  because  it  places  quantitative 
values  on  variables,  but  because  it  forces  the  designer  to  organize  his 
thinking.  If  the  procedures  and  the  results  of  this  systematic  approach 
to  problem  solving  are  presented  to  the  decision  maker,  the  issues  can 
be-  clarified;  then,  the  manager  will  know  what  types  of  decisions  must  bo 
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AACC'XS  High  Cap-. ci 'ey  Subsystem  Example 


Conci'.i  1  Ol)  jeer  i  ye 


The  proposed  Army  Aren  Coi.imuni  cat  ions  High  Capacity  Subsystem  is  to 
be  an  integrated  system  composed  of  multi -channel  fielc  Army  covu.amicntions 
equipment  v.-hich  will  provide  secure  high  quality  circuits  capable  of 
tele-phono,  teletype,  facsimile  and  data  couiiv.ur,  lent  ion  via  l’aciio  and  cable. 
This  system  is  to  provide-  line— of- sic’:-,  t  coimnuni  cat  ions  to  other  Army  area 
signal  centers  (30  mile  radius),  provide  increased  channel  capacity  and 
provide  improved  reliability  and  maintainability. 

The  technical  control  facility  at  the  transmission  center  will  have 
the  capability  of  patching  600  channels,  and  the  technical  control  facility 
of  the  operations  center  will  have  the-  capability  of  patching  300  channels. 
This  system  should  bo  100%  mobile  and  shall  bo  available  to  meet  tactical 
field  Army  requirements  in  1970. 

To  find  additional  general  objectives,  Army  doctrine  should  be 
reviewed.  The  above  was  written  to  provide  an  example  of  what  is  meant  by 
the  term  general  objectives. 

Specific  Kocui  reirw-nt  s 


The  charter  authorizing  the  AACCMS  system  is  very  vague.  In  addition, 
even  though  qualitative  materiel  requirements  (QMil's)  exist  for  individual 
system  components,  no  QMR  has  been  developed  for  the  system.  Therefore, 
a  QMR  must  bo  developed  for  the  system;  then  specific  requirements  developed 

from  the  general  objectives. 

\ 

Representative  requirements  for  the  high  capacity  subsystem  follow: 

3  ' 

1.  Capacity  per  Army  A.rea  Signal  Center 

■  ‘  Tran  Emission  -  600  channels  composed  of  combinations  of  96 
1  channel  groups  and  4S  channel  groups 

Operations  -  300  channels  composed  of  combinations  of  96 
channel  groups  and  various  smaller  groups 
(presently  under  dispute) 
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Either 


2.  Security.  l>i  fforc-ni  levels  of  security  arc  possible, 
of  the  following  could  be  designated  as  th  requirement, 

a.  Secure  from  oper.it  io.vil  confer  to  ope  ntion.il  center. 

'  b.  Secure  from  transmission  confer  to  r rnnsmi salon  center. 

c.  Secure  fro:.,  .subscriber  to  subscriber. 

Note  that  the  first  decision  is  whether  or  not  there  should  be 
security.  The  second  question  is  whether  both  tactical  and  administrative 
messages  should  bo  secure, 

3.  Range:  30  Mile?;.  (According  to  pre-sen’.:  Army  doctrine,  Army 
area  communications  centers  v:i)l  be  located  30  miles  apart.) 

4.  Availability.  There  si. all  be  a  00'/-  probability  that  the 
equipment  will  be  operational  00’/*  o'  the  time. 

5.  Information  rate-:  19.2  or  3S.4  KhS.  (A  multiple  of  73  n  ?.n 
so  that  litis  system  will  interface  with  other  communications  systems.) 


6.  Validity  of  Information.  An  acceptable  error  rate  for  digital 
communi ca L ions  or  a  postdotoctioa  signal /noise  ratio  for  analog  communications 
must  bo  specified. 

A  represent.-:',. j ve  group  of  experts  who  arc  cogni nan',:  of  the  objectives 
and  familiar  with  the  state-of-the-art  of  communications  must  be  gathered 
together  to  develop  the  exact  requirements  for  the  system. 

'Environment  and  Mission  Mix  • 


1.  Either  a  colocated  operations  and  t ran.*. mi ssi on  center  or 
separate  operations  and  transmission  centers  mu..t  be  specified. 


2.  Geographic  and  cl  Untie  conditions.  In  what  areas  cf  the 
world  will  this  equipment'  be  U:.od  •  Various  aeons  must  be  chosen  ..no 
probabilities  assigned  to  each  area.  Only  in  this  way  can  equipment  be 
developed  to  operate-  in  a  ropros«.ntativc  envi  rGiimcnt,  lor  example  -  Eouthcnst 
Asia  is  hot  and  humid  while  Europe  is  colder  ,.nd  not  as  humid.  Even  though 
the  saii.e  circuitry  would  be  used,  the  equipment  package  depends  on  the 
environment,  i 
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M  i  s 1  ■■•ii  Mix 

1  ”  1 

It'  must  be-  determi ;  ic-d  vast  specific  r'oqui  rononts  arc  required  for 
vhat  perceutai;o  of  rite  tots  1  time.  ror  example;  t 

x  3. 1 1  it  X  a  ) 

y  security  )  needed  f or  H7C  of  the  tine 
n  availability) 


A  ranpo  ) 

b  security  )  needed  for  J'A  of .•  the  time 
C  availability) 


etc. 

belli  the  representative-  envi re;.- ent  and  the  mission  mix  i. usfc 
bo  del  ermined  by  a  ^ronp  of  experts, 

Cr i tori  on 

A  minii.iuiii  level  of  effectiveness  rust  be  determined  and  a  cost  eel  line 
must  be  set, 

*  / 
basic  (Vitoria 

1.  After  setting  the  effectiveness  of  all  alternatives  to  the 
mi..io  level,  the.  alternative  v;ith  tb.c  least  cost  is  chosen  or  vice  versa  (as 
loaf;  os  the  ;.>i uis.ui;.-.  level  of  effectiveness  and  the  cost  colling  arc  not 
exceeded.) 

2.  Qualitative  requirements  must  be  set.  Any  special  requirements 
such  as  t  li  t'-  and  a* - r s f av.;  1  should  bo  sot#  lor  example  » 

a .  No  s.ore  tb.an  a  signal  comp.-  ny  should  bo  needed  to  i.ion  each 
Army  ^rca  olj*nnl  e e  ni  r, 

l 

b.  fhe  cane  cl  I  a  t  i  on  clauses  on  so.io  component  contracts 
should  bo  considered . 


i 
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3.  A  list  of  qualitative  factors  which  may  influence  the  decision 
must  be-  developed. 


In  tli i c  section,  the  method  of  evaluating  the  alternatives  which  exceed 
the  in j n i i.iui.i  voluo  .should  bo  determ; net! ,  e , g .  if  the-  range  requirement  ••  30  ml  1  c 
how  valuable  is  AC  mile;;  of  or  30  miles  of  range? 


Again,  a  group  of  experts  should  bo  utilized. 
A1  tern.it  1  vo;; 


1.  The*  exist! .1  g  fy.-.tcm  shoujd  bo  used  os  a  bonchwarh  alcernat ivo  against 
which  the  other  a ltc motives,  ore  compared .  This  cowparl son  is  '.r...do  in 
addition  to  the  comparison  against  the  criteria. 


Primary  altcrnat j ves : 

a.  Method  of  pnvehing  IZll/wUoo 


b.  Channel  groupings  ^ 

fi 

12 

48 


or  combine. Clone 


c.  Various  levels  of  security 


d.  Cable  or  radio  down  the  hill 

c.  Levels  of  system  control  ■  ■ 

The  alternatives  arc  all  combinations  of  A,  B,  (',  I)  A  E. 

Koto  the  internal  trao'ooffs  of  the  above  factors,  c,g.  intrinsic 
availability  depends  upon  both  reliability  onJ  maintainability.  The  external 
cr, 'idyoffs  should  first  be  considered.  After  determining  thu  host  solution, 
then  the  internal  considerations  should  be  optimized.. 


A  ■:  r. i : it  j_on*.  and  Pea  sour, 

1.  Kor  all  alternatives  which  utilize  audio-video  patching,  it  is 


i 


a s named  tha V  the  bopa rl mont  of  the-  Arr.-y  will  authorise  procurement  of  now 
scour i ty  devices.  This  assumption  is  made  because  the.  needed  security 
devices  do  not  presently  exist . 

2.  The  yes r  when  the  equipment  will  be  fielded  must  bo  estimated, 

3.  Knemy  caps b 5  J  i  ty  and  the  state-of-the-art  of  communl cal it  ns  in 
the  pertinent  t. in, t*  fr<i...e  must  be  c-st i mated . 

4.  The  extent  of  interface  required  with  other  systems  such  as  MAJ-1AKD 
and  TACSAVCuM  end  other  subsystems  such  as  the  low,  medium  and  troposcatter 
subsystems  iiiUst  be  estimated, 

5.  The  number  of  area  signal  centers  rust  be  estimated. 

6.  All  other  data  ano  mooc-l  assumptjons  nine  also  be  statC'O. 

Fa  cl's  i  y l_ _ Oocns  '  iU t  1  on 

1.  The  existing  force  structure  as  defined  by  CbC  will  be  in  effect  in 
the  proper  tiro  fr.u.,e,  c.£.  s;  p.aal  centers  will  be  located  30  miles  apart  • 
and  a  sifjr.nl  company  will  man  each  sifpn'.l  center. 

2.  I'u] so  cede  modulation  will  be  used. 

3.  Any  other  technical  and  administrative-  facts  and  the  source  of  tills 
informal i on  must  be  stated. 

Relevant  Variables 


O,  Channel  fji’oup!  np,s 

b.  oecui 1 ty 


c .  lnfois.mll  on  n. .  u 

(  error  rate 

d.  Validity  of  J nformit  1  on  {  patchinj 

1  (  n.ul  tipi  oxers 

,  ,  .  (  ccr  .pl <  :-:ity 

o.  bystei.i  control  ,  .  . 

"  \  personnel  rcquls  assents 


l 


/* 


-  Av.ii  JnM  1 5  'ey  : 

Intrinsic  Aval labi  1  i  ly 


(  reliability 
C  ma i nta inability 


Operation.-!  1  Ava  i  labil  i  ty 


1.  Attriti on  rate 

a.  Failure  rate 

b.  Survi vabi 1 i ty 


(  all  vulnerabilities 
C  M ob i 1 1 ty 
(  silhouette 


2.  Repair  time 

a.  Failure  rate 

b.  Serviceability 

c.  Logistic  time 

o’.  Administrative  time 


The  systematic  use  of  expert  judgment  is  necessary  if  v, 
representative  of  the;  requirements  are  to  be  chosen. 


The  last  stages  of  the  study  process  are  covered  ir 
I  will  conclude  this  example  at  this  point  by  stressing 
end  the  source  of  the  data  must  be  stated  and  it  must  be 
model  development  er.d  data  generation  affect  each  other, 
effort,  the  importance  of  sensitivity  analysis  should  a; 

Tho  problem  will  indicate  which  variables  should  bo  char 
\ 

In  conclusion,  figures  3,4,  5  &  6  should  again  bo 
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STEPS  IN  C2NEKAL  METHODOLOGY 

Define  the  problem 

a,  Define  the  objectives 

b.  Turn  general  objectives  into  specific  reejuiremon 
Define  the  environment  and  the  Mission  mix 
Develop  the  criteria  to  be  used 

Determine  the  alternatives 

Determine  t'no  relevant  variables,  assumptions,  and  f 

Generate  tno  oat a 

Develop  the  model 

Exercise  the  model 

Analyze  the  results  of  the  model 

Present  the  results  of  the  study  effort 

'  V 
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